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Two case studies are described in which human performance 
methodologies were applied during the development of the Automated 
Repair Service Bureau (arsb). The first case study illustrates some of 
the human performance analysis and design conducted during the 
specification of the computerized work station that would replace the 
local test desk in Repair Service Bureaus. The second case study 
shows how job quality considerations led to improvements in the job 
of the Repair Service Attendant who receives initial telephone trouble 
reports from customers. At the same time, a net savings in the time to 
process the troubles was achieved. 

I. INTRODUCTION 

This paper discusses some of the procedures and results of human 
performance design and analysis work carried out during the devel- 
opment of the Automated Repair Service Bureau (arsb). It illustrates 
several ways that human performance analysis has benefited the 
design and operation of the arsb. Two case studies are presented: 

(i) Analysis and design for the computerized work station that 
replaces the local test desk for testing telephone lines in telephone 
repair bureaus. 

{ii) Application of job enrichment techniques to the Repair Service 
Attendant's (rsa's) job in the arsb. 

II. PROCEDURES FOR HUMAN PERFORMANCE ANALYSIS AND DESIGN 
IN THE ARSB 

2. 1 Background: Use of the local test desk in the pre-ARSB environment 
The local test desk is an electromechanical console characterized by 
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analog meter scales, toggle switches, electrical cords, and flashing 
buttons. Its basic testing modes of operation have been in use, virtually 
unchanged, for over forty years. It includes both testing and commu- 
nication capabilities, and permits several telephone lines to be accessed 
simultaneously for testing. 

In the pre-ARSB environment, skilled technicians called testers, 
working at the local test desks, perform tests on telephone lines to 
establish probable causes of trouble on a line. They work from paper 
trouble reports passed to them by repair clerks who receive customer 
complaints. Testers also assist craft persons in the field who call in, 
requesting tests on lines they are working on. The tester is the one 
who normally makes dispatch decisions and finally ensures that par- 
ticular troubles are repaired. Telephone trouble reports requiring 
dispatching are routed from testers to dispatchers, who assign jobs to 
craft persons calling in upon completion of previous jobs. 

Analytical skills, as well as interpersonal skills, are required for a 
person to be a successful tester. In addition, the tester has to be a good 
coordinator of the repair process. The tester is normally the one who 
is responsible for ensuring that a trouble is dealt with to the customer's 
satisfaction. 

In the first phase of the introduction of Mechanized Loop Testing 
(mlt), the number of testers required at a repair bureau was reduced. 
The content of the tester's job tended to shift towards those tasks 
which mlt was not designed to do conveniently, such as testing 
interactively with craft persons in the field. The tester, when provided 
with a Video Display Terminal (vdt) giving mlt tests, often continued 
to use the local test desk as before. 

The first phase of mlt was not designed to replace the local test 
desk entirely. This is principally because of the highly interactive 
nature of the tester's job and the power and flexibility of the local test 
desk in providing a variety of specific tests suitable for troubleshooting 
more complex telephone problems. 

The systems engineering requirement to replace the local test desk 
with a vdt interface and appropriate communications capabilities 
came during the second stage of the implementation of the arsb. This 
required that all testing be carried out under computer control. 

2.2 Definition of the problem 

When replacing one testing system with another, the general require- 
ment is to ensure that the new system permits the functional capabil- 
ities appropriate to the new work environment. The human perform- 
ance design goal is to help specify the user interface to the new system 
and to ensure that the tasks associated with the new system are suited 
to the abilities and needs of the users of the new system. 
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The mlt system specification required that we design a vdt interface 
that, together with a proper communications set, would be the func- 
tional equivalent of the local test desk. That is, the new work position 
would provide the testing and communications capabilities so that 
users could perform the functions that were previously performed at 
the local test desk. Of course, the absence of the local test desk, and 
the presence of a set of tests at the vdt that provides the equivalent 
or better testing capabilities, will permit operating companies to struc- 
ture the processing of trouble reports in a more flexible way than is 
currently possible with the presence of the local test desk. 

2.3 Rationale lor analyzing the previous system 

While the testing and communications features of the local test desk 
are known, we needed to know the way these features were applied in 
an operational environment, and which features were considered im- 
portant or crucial by users. This knowledge would facilitate the transfer 
of testing capabilities to a vdt testing mode, and permit us to retain, 
where possible, the operational features considered to be the most 
advantageous. 

We needed to understand fully what testers perceived to be the 
main advantages of the test desk. By this approach, we could attempt 
to incorporate as many as possible of these advantages into a vdt 
testing design. At the same time, we wished to make full use of the 
advantages of the vdt medium, as applied to testing areas. 

2.4 Analysis of testing requirements 

We decided to observe testers doing their jobs in a normal opera- 
tional environment. This observational study approach was chosen to 
assess what types of tests were actually done at a local test desk, and 
the conditions under which testing was done. 

Over a period of several months, we closely observed testers' activ- 
ities in three different operating companies by sitting with and talking 
to testers in their normal course of work activities. One of our early 
observations concerned the highly interactive nature of the tester's 
job. Much of a tester's time is spent communicating and coordinating 
repair activity among a variety of telephone company personnel. 
Actual testing of phone lines is only one of a large variety of tasks that 
testers carry out. 

It became clear that the design of the local test desk replacement 
would have to facilitate both the testing and the communications 
portions of the tester's job. Neither portion could be neglected. The 
interactive nature of the tester's job often requires the tester to work 
on several problems in parallel. A tester can be working on a problem 
with one craft person when a second craft person calls in requesting 
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assistance. If the second request can be dealt with quickly, the tester 
may take care of it, then return to assisting the first craft person. 
Otherwise, the second craft person, as well as subsequent callers, will 
be temporarily placed on hold until the tester has finished working on 
the earlier problems. 

We observed a high degree of interaction between the tasks of 
testing and communicating. Testers often would be testing a line at 
the same time they were talking with the person who needed the test. 
We also observed some of the work pressures confronting testers on 
their jobs. Pressures could be caused by work load, ambiguities in the 
analysis of telephone troubles and deciding what actions to take, and 
delays caused by waiting to talk to other telephone company personnel. 
Also, working simultaneously on several troubles or having several 
other craft persons waiting on hold can further add to work pressures. 
We came to appreciate why one tester characterized his job as "fighting 
the test desk," although this characterization was mainly because of 
the pressures of interpersonal interactions, decision making, and time 
limitations rather than because of problems with the test desk itself. 

2.5 Results and implications of observational study — guidelines for 
design 

The preceding analysis of the tester's job yielded a set of design 
guidelines that will be used in creating a new work position and a new 
job category. The new job title will be Maintenance Administrator or 

MA. 

The ma should be able to use the system flexibly for requesting 
interactive testing with craft persons and customers. Interactive testing 
requires that a craft person or customer participate in some way while 
a line is being tested. Voice contact between the ma and the craft 
person or customer is present during the interaction, usually both 
before and after testing the line. The system should as much as possible 
facilitate this interactive testing process so that it proceeds smoothly 
and efficiently. We decided that the required system for interactive 
testing would have the following characteristics: 

(i) Required tests can be requested easily by the ma. 
(ii) Appropriate communications and conference capabilities will 
be available. 

(Hi) The system will permit the request for interactive tests by mas 
with craft persons or customers in as close to a "real time" mode as 
possible, i.e., interactive testing will not be held up unduly while 
waiting for test results from the system. 

(iv) Talking and testing over the same line will be possible in a way 
that facilitates interactive testing. 

(v) Several lines can remain accessed simultaneously and be sta- 
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tused appropriately so that the ma can conveniently work with several 
craft persons requiring intermittent assistance. 

(vi) It will be possible to conveniently check detailed records for a 
line that is being tested. 

(vii) The system will supply certain relevant line record information 
when test results on a line are returned. 



2.6 The design of the human interface for testing and communications 

(i) General features — The preceding testing and communications 
requirements led, after many design and redesign efforts, to a human- 
computer interface tailored specifically to the needs of the ma for 
requesting the tests formerly done at the local test desk. The requests 
available to an ma consist of test and information requests that permit 
testing to occur in a timely fashion in the normal working environment. 
The vdt display, or mask (called the tv mask, for Trouble Verifica- 
tion), developed for this purpose permits the ma to request these tests 
in a convenient manner. The tv mask provides a sophisticated visual 
display terminal or vdt interface for testing, as well as initiating 
certain communications with craft persons and subscribers. 

A status region of the mask indicates all lines that are currently 
accessed by the system. For maximum flexibility, tests can be re- 
quested on any of the lines accessed. Up to five lines can be accessed 
at the same time so that, for example, tone may be placed on several 
lines, while the ma is working on another line. If the ma switches to 
another mask containing records, the original tv mask with all status 
information is stored and returned to the ma on request. 

The communications console associated with the vdt will provide 
the ma with the necessary features for communications needs. Such 
features include conferencing capability, speed dialing of commonly 
used numbers, and appropriate sizing and arrangement of incoming 
and outgoing lines. 

The vdt and communications console can be used in an integrated 
manner to allow the ma to talk and then request tests over the same 
telephone line, without having to drop and then reaccess the line. 
When the ma enters a telephone number on the TV mask and requests 
a talk line, the test system accesses the designated line for testing, and 
calls back the ma at the ma's work position over the communications 
console. When the ma answers the phone, the test system connects 
the ma's line to the line to be tested. The ma can then talk over the 
line, for example, to a customer or a craft person in the field, and then 
run tests on the line from the TV mask. When each test ends, the talk 
path is automatically restored so conversation can continue. This 
talking and testing path greatly facilitates the ma's job, which requires 
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a high degree of verbal interaction integrated with testing of phone 
lines. 

(ii) Specific examples of VDT test capabilities — Here are three 
examples where an orientation towards the ma's needs and preferences 
resulted in appropriate testing capabilities being specified and imple- 
mented. All of these tests take into account the need for rapid system 
responses required for interactive testing with outside craft persons. 

(a) Tone — Often a tester in a telephone repair bureau puts a tone on 
a pair to enable a craft person to find the pair by using a variety of 
tone detecting apparatus. When the craft person finds the pair, often 
the craft person wishes to signal the tester for assistance with testing 
the line. Here is how this is accomplished with the new system. 

A craft person calls the ma requesting a tone on a certain telephone 
number to locate the pair of wires associated with that telephone 
number. The ma will type in the telephone number on the TV mask 
displayed on the vdt screen. The ma then types in TONE in a request 
field. The ma can then go on to testing other telephone lines, while 
tone is supplied to the requested telephone number. 

When the craft person finds the telephone line with the tone on it 
and shorts that pair of wires, the ma's screen will signal this by a beep 
and brighten the status line on the screen corresponding to the 
appropri'ate telephone number. The ma can then request T (for Talk) 
on that telephone number. The tone will then be dropped automati- 
cally and one of the ma's phones will ring, providing the ma with a 
talking path over that telephone line to the craft person in the field. 
Further testing and talking over that telephone line can then proceed 
by the ma's entering appropriate test and communication requests 
from the tv mask. 

(b) Pair identification — Often a craft person will identify a pair of 
telephone wires in the field by placing an electrical short or ground on 
the pair and asking a tester, who is accessed to a specific pair, if the 
tester "sees" the short or ground by an immediate deflection of the 
needle on the tester's electrical meter. The craft person may try to 
locate a particular telephone pair by shorting or grounding a number 
of neighboring pairs often in rapid succession. To permit this pair 
identification capability from a vdt, the arsb system was designed to 
measure and report a shorted or grounded telephone pair in a "real 
time" mode, i.e., without the several-second delay required for a result 
to be reported from the remote test equipment to the vdt screen. 

To get into this "look for short" mode, the ma enters a telephone 
number and requests the command S (for short) at the TV mask. This 
sets the test equipment in a continuous measuring mode for detecting 
a short or ground placed on a line by a craft person. At the same time, 
the system calls one of the ma's telephones, providing a direct connec- 
tion between the remote test equipment and the ma. 
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As soon as the craft person places a short or ground on the pair 
corresponding to the entered telephone number, the remote test equip- 
ment detects it and sends a tone back to the ma over the telephone 
line. The ma, who is in voice contact with the craft person over another 
line, can then immediately tell the craft person that the correct pair 
has been contacted. In fact, the ma may direct that the system call 
back the craft person directly to provide tone information that indi- 
cates when the craft person has shorted the pair. The tone remains on 
until the craft person removes the short or ground that was applied, 
and reappears if the short or ground is reapplied. By design, the tone 
is not sent back to the ma for a preexisting short or ground on the line. 
Only a change of conductivity corresponding to the application of a 
short or ground by a craft person is signaled. 

This "look for short" mode will be very useful for interactive testing 
with outside craft persons, where rapid response times are highly 
desirable. Without human performance design input at an early stage 
in the project, this useful capability would certainly not have been 
implemented in its present form. The capability required that specific 
changes be incorporated into the system design. These changes would 
have been more costly to introduce into the design at a later stage. 

(c) Quick single-ended test series — Another way was found to meet 
the ma's need for rapid test results when interacting with outside craft 
people. A stripped-down version of the previously implemented full 
test sequence was designed. The full sequence is carried out on a line 
to characterize the full extent of problems on the line, and to compare 
observed results with stored records. We determined that much of this 
detailed information is not always necessary or relevant during inter- 
active work with outside craft people. The new QUICK test that 
resulted is expected to reduce the time to get useful test results by a 
factor of four or so, to about 5 seconds as compared to about 20 seconds 
for the complete test sequence. 

2.7 Summary 

In the full arsb environment, a new computerized work station will 
replace the local test desk. A variety of tests and information requests 
will be carried out by an ma from a vdt, with a communications 
terminal being used as appropriate to facilitate the testing and coor- 
dination process. The ma will also provide assistance to craft persons 
who call in with requests for tests or information on lines they are 
working on in the field. 

2.8 Conclusion 

In conclusion, the application of human performance approaches 
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during the arsb system design stage yielded significant benefits. It 
provided the opportunity for human performance designers to contrib- 
ute to an ultimate system design that would be efficient and effective 
from the final user's point of view. 

Section III illustrates another area where human performance design 
considerations had an important effect on job design and job quality 
in the arsb. 

III. JOB ENRICHMENT IN THE CENTRALIZED REPAIR SERVICE 
ANSWERING BUREAU 

With the implementation of Loop Maintenance Operations System 
(lmos) in arsbs, the job of the rsa was removed from individual 
Repair Service Bureaus (rsbs) and placed in Centralized Repair Ser- 
vice Answering Bureaus (crsabs). Each crsab serves several rsbs. 
Centralizing the rsas takes advantage of the efficiencies possible from 
combining several smaller work forces that perform the same function 
into a single larger unit. 

The rsa is the initial telephone company contact when a customer 
calls to report a telephone service problem. The rsa works at a vdt 
and operates a keyboard, which is connected to a computer. A cus- 
tomer calling to report a telephone problem is automatically connected 
to an rsa. The rsa obtains the customer's phone number, and enters 
it into a "Trouble Entry" mask on the vdt. The computer responds by 
displaying on the terminal a Trouble Report mask. This mask provides 
the customer's name, the address for that particular phone number, 
and the date of the last trouble cleared. 

The rsa verifies the name and address, asks the customer to describe 
the trouble, enters the trouble description into the Trouble Report 
mask, and determines whether the trouble requires a repair visit to 
the customer's premises. If a repair visit is needed, the rsa makes an 
appointment with the customer and gives a time of day commitment 
for repair of the trouble. When the customer hangs up, the rsa 
transmits the trouble report to the computer. 

The computer forwards the trouble report to the rsb, where a 
printout is made available. The computer updates its history files and 
presents a new Trouble Entry mask so that the rsa is ready to answer 
the next customer's call. 

3.1 The problem 

One consequence of centralizing the rsas that was not fully antici- 
pated was the effect on the rsa's job. In the decentralized environment, 
the rsas frequently had the necessity and opportunity to discuss 
trouble reports with other employees. They also had the opportunity 
to do a variety of tasks (fill work) when the number of trouble calls 
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was low. In the crsab environment, the rsa's job does not normally 
require them to converse with other employees and the work is more 
repetitive with less variety. For example, a busy day may require an 
rsa to handle up to 270 calls — one every 100 seconds. 

A survey of rsa attitudes regarding their jobs in the centralized 
environment indicated dissatisfaction with the repetition and lack of 
variety. 1 Another key area of concern was their lack of decision- making 
authority. Further study of the rsa job in the centralized environment 
led to the hypothesis that the quality of the job could be improved. 

3.2 Approach to a solution 

The purpose of the present study was to determine if the quality of 
the rsa job could be improved, while preserving the efficiencies pro- 
vided by centralization. The approach taken was to apply one of the 
principles of job enrichment and try it out in a crsab. These principles 
indicate that a job designed to maximize interest, challenge, and 
satisfaction for an employee must do three things: 

(i) Allow the worker to do a complete piece of work for an identi- 
fiable client. 

{ii) Give the worker a high degree of control and decision-making 
authority over how that complete piece of work is carried out. 

(Hi) Provide direct feedback — from the worker's clients and through 
the work itself — on how well the worker is doing the job. 2 

The trial discussed here focused on giving the rsas more decision- 
making authority. This is not to imply that the other principles were 
well fulfilled in the rsa job, but only that they would be dealt with in 
later trials. 

Increased decision-making authority in the rsa job was made pos- 
sible by the development of the mlt, which automatically tests the 
customer's telephone line while the customer and the rsa are talking. 
The results of the test are then displayed on the rsa's display terminal. 

Based on the information made available by the mlt — along with 
customer information — the rsa can make three important decisions 
during the customer contact: 

(i) whether to obtain access to the customer's premises, 
(ii) whether to attempt front end close-out of the trouble, that is, 
to get agreement from the customer that there is no longer a problem 
with the line, and 

(Hi) whether to suggest that the customer take the phone set to the 
Phone Center Store for replacement. 
Each of these decisions is discussed below. 

If the mlt indicates that the trouble is in the central office or in the 
cable, no access to the customer's premises is needed. The time that 
the rsa must spend talking with the customer can be shortened. 
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If the mlt results indicate the customer's line is OK and certain 
other conditions exist, there may be no need for the telephone company 
to take any action on the trouble report and the rsa can attempt a 
front end close-out. For example, a customer may try to use his phone 
before leaving for work in the morning and discover he has no dial 
tone. By the time he calls in from his place of work to report the 
trouble, the problem may have been corrected at the Central Office. 
When the service attendant uses the mlt, it will indicate TEST OK. 
The attendant can then tell the customer that the line checks OK, and 
indicate that no further action is required. If the customer agrees, the 
rsa can complete a front end close-out transaction that updates the 
computer but sends no trouble report to the rsb. This saves the rsb 
from handling and processing a trouble that is nonexistent. 

The third type of decision also requires information from the cus- 
tomer. If, in describing the service problem, the customer indicates the 
trouble is with only one telephone set among several in the home, and 
if mlt shows that no other problem exists, then the rsa can ask the 
customer to take the suspected set to the Phone Center Store. If the 
customer accepts the suggestion, the attendant can use the front end 
close-out transaction to update the computer, but send no trouble 
report to the rsb. Again, the Bureau is spared the handling of a trouble 
report that actually requires no action on the Bureau's part. 

3.3 Design of the Mai 

The trial included a sample from one crsab of six rsas who used 
mlt results during their contact handling. The rsas selected for the 
trial were considered to be "typical" attendants — not the best nor the 
worst. Three males and three females participated. Their ages ranged 
from 18 to 27 years and their experience ranged from 4 to 18 months. 
Following initial training, the six rsas used the new procedures during 
a two-month period. 3 

3.4 Results of the trial 

As the six trial rsas used mlt results during contact handling, the 
impact on rsa performance and job attitude, impact on the rsb and 
reactions of customers were assessed. 

(i) RSA job performance and attitudes — One prime rsa perform- 
ance measure considered was the impact on holding time of using the 
mlt results during the contact. Holding time is defined as the interval 
starting when the rsa first receives the customer's call until the RSA 
transmits the Trouble Report mask for that trouble. Table I provides 
a summary of results. 

The data indicate that, on the average, front end close-outs took 
about 35 seconds longer to handle than ordinary customer contacts. 
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Table I — Holding time tor customer contacts 

Number of Mean Holding Range of Hold- 
Calls Moni- Time (sec- ing Time (sec- 
Type of Trouble tored onds) onds) 

Front end close-out troubles 41 145 62 to 274 

Cable and Central Office trou- 61 77 38 to 238 

bles 

Ordinary troubles 654 110 33 to 559 

Total 756 109 33 to 559 



The close-out transaction and the need for rsas to call back some 
customers to obtain agreement to the close-out account for the extra 

time. 

On the other hand, for contacts where the trouble was found to be 
in either the Central Office or in the cable, the average holding time 
was about 33 seconds less than would be required on an ordinary 
customer contact. This shorter holding time was because the rsa did 
not have to arrange access to the customer's premises. 

The attitudes of the trial rsas toward the use of mlt results in then- 
contact handling were very favorable. When interviewed, the rsas said 
they particularly liked the increased information that they could share 
with customers, the increased challenge of making more decisions, and 
the increased importance of their job in that they could save the rsb 
paperwork on front end close-outs. 

(ii) Impact on the RSB— One impact that the new mlt procedures 
have on the rsb is measured in terms of the amount of trouble report 
processing saved. Every trouble that is closed out by an rsa means 
one less trouble to be processed by the Bureau. Data from the trial 
show that if a trouble closed out by the rsas had been transmitted to 
the Bureau, it would have required an average of 129 seconds of 
handling by Bureau personnel. As noted earlier, the increase in average 
rsa holding time because of front end close-out was 35 seconds. 
Therefore, it seems that for an additional 35 seconds of rsa time, 129 
seconds of rsb time can be saved. The data in Table II show that 
nearly 8 percent of the calls taken were candidates for front end close- 
out. 

Table II also shows that more than half the customers who were 

Table II — Frequency of use of MLT results by RSAs 





Type of Contact 


Number 


Percentage 




Front end close-out candidates: 








Accepted by customer 


125 


4.6 




Refused by customer 


88 


3.2 




Cable and Central Office troubles 


272 


10.1 




Ordinary contacts 


2212 


82.1 




Total 


2697 


100.0 
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offered a front end close-out accepted. Those who refused usually did 
so because they had checked their telephone recently — within the last 
hour — and felt there still was a legitimate problem, even though the 
rsa's test equipment indicated that the line was working. 

Another impact the new mlt procedures might have had on the rsb 
would be to change the number of repeat calls made on troubles 
originally closed out by the rsas. However, the data showed that for 
troubles closed out by rsas during the trial, the repeat rate was the 
same as that for troubles of this type closed out by the rsb during the 
same time period. 

(mi) Reactions of customers — To learn how customers reacted to 
the use of mlt results in their contact with an rsa, several hundred 
contacts were monitored. Customers always reacted favorably when 
told their telephone trouble was in the cable or Central Office and that 
access to their premises was not necessary. Similarly — but to a lesser 
degree — customers appeared to appreciate the rsa's informing them 
that the test equipment had identified a definite fault, even though 
that meant the customer had to arrange access to the premises. 

To find out what customers thought of their telephone line being 
automatically tested during their contact with the rsa, a sample of 60 
customers was surveyed by telephone. When asked about their reac- 
tion to the automatic testing, half gave positive reactions and half were 
neutral. None gave a negative response. 

3.5 Conclusion from the trial 

In conclusion, having rsas use mlt results during customer contacts 
has far more benefits than costs. The benefits are savings in time for 
the rsb, improved customer relations, and a more satisfying job for 
the rsas. The cost is the time required to train rsas to use the new 
procedures. 
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